Goto

Collaborating Authors

 multivariate time-series forecasting




Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting

Neural Information Processing Systems

Multivariate time-series forecasting plays a crucial role in many real-world applications. It is a challenging problem as one needs to consider both intra-series temporal correlations and inter-series correlations simultaneously. Recently, there have been multiple works trying to capture both correlations, but most, if not all of them only capture temporal correlations in the time domain and resort to pre-defined priors as inter-series relationships. In this paper, we propose Spectral Temporal Graph Neural Network (StemGNN) to further improve the accuracy of multivariate time-series forecasting.


Multivariate Time-Series Forecasting with Temporal Polynomial Graph Neural Networks

Neural Information Processing Systems

Modeling multivariate time series (MTS) is critical in modern intelligent systems. The accurate forecast of MTS data is still challenging due to the complicated latent variable correlation. Recent works apply the Graph Neural Networks (GNNs) to the task, with the basic idea of representing the correlation as a static graph. However, predicting with a static graph causes significant bias because the correlation is time-varying in the real-world MTS data. Besides, there is no gap analysis between the actual correlation and the learned one in their works to validate the effectiveness.



SpikeSTAG: Spatial-Temporal Forecasting via GNN-SNN Collaboration

Hu, Bang, Lv, Changze, Li, Mingjie, Liu, Yunpeng, Zheng, Xiaoqing, Zhang, Fengzhe, cao, Wei, Zhang, Fan

arXiv.org Artificial Intelligence

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, offer a distinctive approach for capturing the complexities of temporal data. However, their potential for spatial modeling in multivariate time-series forecasting remains largely unexplored. To bridge this gap, we introduce a brand new SNN architecture, which is among the first to seamlessly integrate graph structural learning with spike-based temporal processing for multivariate time-series forecasting. Specifically, we first embed time features and an adaptive matrix, eliminating the need for predefined graph structures. We then further learn sequence features through the Observation (OBS) Block. Building upon this, our Multi-Scale Spike Aggregation (MSSA) hierarchically aggregates neighborhood information through spiking SAGE layers, enabling multi-hop feature extraction while eliminating the need for floating-point operations. Finally, we propose a Dual-Path Spike Fusion (DSF) Block to integrate spatial graph features and temporal dynamics via a spike-gated mechanism, combining LSTM-processed sequences with spiking self-attention outputs, effectively improve the model accuracy of long sequence datasets. Experiments show that our model surpasses the state-of-the-art SNN-based iSpikformer on all datasets and outperforms traditional temporal models at long horizons, thereby establishing a new paradigm for efficient spatial-temporal modeling.



Review for NeurIPS paper: Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting

Neural Information Processing Systems

Summary and Contributions: This paper addresses the problem of multivariate time-series prediction. The premise of the problem is, given N possibly correlated time series, predict the next H time steps for each of the time series. The paper develops over existing methods by proposing a novel deep neural network based algorithm that simultaneously accounts for the "spatial" and temporal correlations. The proposed algorithm first constructs an adjacency matrix to capture the similarity between the different time series by using a self-attention based similarity measure. Post this, the data is passed through two "stemGNN" blocks, with each block as described below.


Review for NeurIPS paper: Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting

Neural Information Processing Systems

Four expert reviewers have recommended acceptance of the paper and I agree with them. However, the final version of the paper should reflect a request from Reviewer #4 to include specific empirical comparisons.


Multivariate Time-Series Forecasting with Temporal Polynomial Graph Neural Networks

Neural Information Processing Systems

Modeling multivariate time series (MTS) is critical in modern intelligent systems. The accurate forecast of MTS data is still challenging due to the complicated latent variable correlation. Recent works apply the Graph Neural Networks (GNNs) to the task, with the basic idea of representing the correlation as a static graph. However, predicting with a static graph causes significant bias because the correlation is time-varying in the real-world MTS data. Besides, there is no gap analysis between the actual correlation and the learned one in their works to validate the effectiveness.